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CROSS REFERENCE TO RELATED APPLICATION 

[1] This application claims the priority of Swiss Appli- 
cation No. 2000 1280/00 filed June 28, 2000, which is incor- 
porated herein by reference. 

BACKGROUND OF THE INVENTION 

[2] This invention relates to an apparatus for forming 
images of items advanced in an organized or random manner on 
one or several conveyors. The apparatus has at least one 
illuminating unit and at least one image-capturing unit 
(camera) associated with the illuminating unit. The image- 
capturing unit forms images of the items on the conveyor. 
The apparatus further includes a control device which con- 
trols the illuminating and image-capturing units, for exam- 
ple, in a manner as described in United States Patent Nos. 
4,972,093 and 5,936,353. 

[3] An apparatus of the above-outlined type is disclosed 
in European Patent No. 0 856 465 which does not describe any 
specific illuminating device. An illumination by environ- 
mental light has the disadvantage that the reception of the 
line camera described in the patent may be adversely af- 
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fected by interfering environmental light effects and thus 
the article-manipulating gripper devices cannot be accu- 
rately controlled. 

[4] Conventional illuminating devices have the addi- 
tional disadvantage that their light sources radiate heat 
which may lead to a deterioration of the item quality, par- 
ticularly in case of heat sensitive items such as food prod- 
ucts, particularly chocolate or glazed items. 

SUMMARY OF THE INVENTION 

[5] It is an object of the invention to provide an appa- 
ratus of the above -out lined type which improves the quality 
of the item images without exposing the items to thermal 
stresses . 

[6] This object and others to become apparent as the 
specification progresses, are accomplished by the invention, 
according to which, briefly stated, an article -conveying 
system includes a conveyor for advancing items thereon; and 
an image -capturing apparatus for detecting individual items 
on the conveyor and for generating image signals represent- 
ing an image of the items. The image -capturing apparatus 
includes an illuminating unit formed of a matrix composed of 
a plurality of light -emitting diodes; a picture-capturing 
unit for receiving light rays emitted by the matrix and 
- 3 - 



modified by an item situated in a path of the light rays and 
for generating the image signals; and a control unit con- 
nected to the matrix and the picture- capturing unit for a 
pulsed illumination of the matrix. 

[7] By illuminating a surface occupied by an item and a 
region adjoining such an item by the light -emitting diode 
matrix in a homogeneous manner, the recognition zone of the 
image -capturing unit may be better utilized as concerns the 
orientation and position of the items. The high degree of 
efficiency of the light-emitting diode matrix reduces the 
effect of heat emitted by the illuminating body. Such a 
heat effect may be further reduced by a pulsed drive of the 
matrix and, in addition, single-color light -emitting diodes, 
in conjunction with a suitable color filter arranged in 
front of the image -capturing unit may further reduce an in- 
terference by scattered light. 

[8] The light -emitting diodes in the matrix operate ei- 
ther in a transmitted-light mode or in a ref lected-light 
mode. In the former mode the matrix is positioned under- 
neath the item carrying conveyor belt where advantageously 
the belt serves as a light diffuser. In the ref lected-light 
mode the light is parallelized to produce a directed inci- 
dent light . 

[9] If, as noted earlier, the light-emitting diode ma- 
trix, by means of shutter control, emits light only during 
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the image-capturing periods, a pulsed light beam results, 
whereby a homogenous illumination of the items may be ob- 
tained, without the items being exposed to appreciable heat 
stress. This circumstance therefore allows a positioning of 
the light-emitting diode matrix closer to the items, whereby 
the quality of illumination is further improved. At the 
same time, the short illuminating period permits a very ac- 
curate image -capturing of the items even at high item- 
transporting speeds. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[10] Figure 1 is a schematic top plan view of a light- 
emitting diode matrix for use in an apparatus according to 
the invention. 

[11] Figure 2 is a schematic side elevational view of an 
embodiment of the invention operating with transmitted light 
with illumination from below. 

[12] Figure 3 is a schematic side elevational view of an 
embodiment of the invention operating with transmitted light 
with illumination from above. 

[13] Figure 4 is a schematic side elevational view of an 

embodiment of the invention operating with reflected light 

with oblique illumination from above. 

[14] Figure 5 is a schematic side elevational view of an 
- 5 - 



embodiment of the invention operating with reflected light 
with the interposition of a beam splitter. 

[15] Figure 6 is a schematic side elevational view of an 
embodiment which is in part a combination of the embodiments 
of Figures 2 and 4 and which further shows a gripper con- 
trol . 

[16] Figure 7 is schematic side elevational view of an 
embodiment generally according to the arrangement of Figure 
2, including an item storage control. 

[17] Figure 8 is a schematic side elevational view of an 
embodiment generally according to the arrangement of Figure 
2 , further showing a gripper control . 

[18] Figure 9 is a schematic side elevational view of an 
embodiment of the invention generally according to the ar- 
rangement of Figure 2, wherein such arrangement is disposed 
in the operational zone of a gripper. 

[19] Figure 10 is a schematic side elevational view of an 
embodiment of the invention operating with reflected light 
and with a camera located in the center of the light- 
emit i ting diode matrix. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 



[20] Figure 1 shows a light -emitting diode matrix 1 com- 



posed of a plurality of light -emit ting diodes 2 arranged in 
rows and columns. For example, there may be provided 432 
light -emitting diodes arranged in 12 columns and 36 rows. 
The light -emitting diodes 2 as viewed together, constitute 
the light emitting surface. A control circuit 3 is con- 
nected to the matrix 1 which is controlled by symbolically 
illustrated control pulses 4 and which may forward control 
pulses 5 from an output to a further matrix (not shown) im- 
mediately adjoining the matrix 1 for the purpose of increas- 
ing the number of matrix columns. Thus, the matrices may be 
disposed in a cascade connection. 

[21] A cascade arrangement is of advantage because con- 
trol pulses need to be applied only to the first matrix 1; 
the control pulses are then taken over by the various cas- 
caded matrices . Such control pulses represent , in case of 
an intermittent operation of the matrix, the duration and 
timing of the energized state of the light-emitting diodes 
2. Advantageously, in a flash operation, the light -emitting 
diodes 2 are driven synchronously with an image -capturing 
operation of a camera or imaging unit 10 . The duration of a 
flash period may be 1 ms . In case of a speed of 60 m/min of 
the conveyor belt 6, the image fuzziness amounts to 1 mm. 

[22] A matrix 1 with light-emitting diodes 2 makes possi- 
ble a pulsed operation of the light -emitting diodes with an 
illumination period of 0.1 ms . When using a separate volt- 
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age supply for the light-emitting diodes 2 and for the sig- 
nals of the control computer, the control signals are main- 
tained potential -free by means of optical couplers which 
preferably have limit frequencies of over 100 kHz. It is a 
further advantage of the light-emitting diodes 2 that they 
are simple to control by low voltage devices and they age 
slowly. 

[23] The matrix 1 composed of 432 light -emitting diodes 
as noted above, has a width of 100 mm and a length of 3 00 mm 
as viewed in the conveying direction of the conveyor 6. By 
providing a cascade arrangement of several light -emitting 
diode matrices the light source may be adapted to any con- 
veyor width. Thus, with eight matrices 1 in cascade connec- 
tion a conveyor belt surface which is 3 0 cm long and 80 cm 
wide may be illuminated. 

[24] Preferably, the matrix 1 or interconnected matrices 
1 are placed in a protective casing whose top side is of a 
clear transparent material such as PLEXIGLAS . In the de- 
scription below, matrix and matrix module (with several ma- 
trices) is used interchangeably and provided with the same 
reference characters. Further, identical reference charac- 
ters designate identical features. An individual matrix 1 
as well as a module has a compact, flat construction. 

[25] Figure 2 shows an arrangement operating with trans- 
mitted light. The matrix 1 is positioned underneath the 
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conveyor belt 6 and illuminates the latter from below with 
parallel light rays 7. The conveyor belt 6 functions as a 
diffuser. The image -capturing unit (camera) 10 is situated 
above the conveyor belt 6 . The light passing by an item 8 
and thus not reflected thereby, is received in the sensor 
cone 9 of the camera 10 and is subsequently further proc- 
essed. It is an advantage of this arrangement that the 
light-emitting diode matrix 1 may be disposed closely under 
the conveyor belt 6. Based on the short illumination peri- 
ods (the light-dark ratio may be, for example, 1:100 and the 
duration of illumination may be 0.2 ms) and the use of 
light -emitting diodes 2 practically no heat is emitted which 
could damage the items 8. Further, the light -emit ting di- 
odes 2 have a high degree of efficiency. It is further fea- 
sible to make the module 1 watertight for removing the gen- 
erated heat by convection cooling. 

[26] The light -emitting diodes 2 may have any desired 
color, such as close to the infrared range, red, blue, yel- 
low or green. Preferably, all the light -emitting diodes 2 
are of the same color. In case no white light-emitting di- 
odes 2 are used but, for example, identical red diodes, that 
is, monochromatic diodes 2, find application, then in front 
of the camera 10 a color filter 10a for the same wavelength 
range may be used. As a result, the camera 10 receives only 
transmitted light components which essentially originate 
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from the matrix 1. Thus, environmental light effects (ex- 
cept for those in the transparent frequency range) may be 
further reduced. 

[27] Figure 3 shows an arrangement which operates with 
transmitted light and which includes a camera 2 0 situated 
underneath the conveyor 6. The sensor cone 9 of the camera 
2 0 is directed to the reverse outer face of the conveyor 
belt 6 and captures the items in transmitted light emitted 
by a light -emit ting diode matrix 11. 

[28] Figure 4 shows a further embodiment operating with 
reflected light or dark field illumination. A light - 
emitting diode matrix 31 is positioned obliquely above the 
sensor range cone 9 of the camera 10 and illuminates the 
item 8 with a light beam 17. The diffused scattered light 
enters the camera 10 and is utilized for evaluating the im- 
age signal . 

[29] Figure 5 shows a reflecting light arrangement in- 
cluding a beam splitter 12 which is oriented at an angle of 
45° to the upper surface of the conveyor belt 6. In this 
preferred arrangement the light-emitting diode matrix 41 is 
oriented perpendicularly to the conveyor belt 6 . An optical 
element 41a is positioned at the output of the matrix 41 to 
obtain a paralellized incident light beam 27. The latter is 
deflected by the beam splitter 12 to obtain a beam 3 7 with 
parallel rays. After the beam 37 impinges on the item 8 and 



the conveyor belt 6, the reflected light is received by the 
sensing cone 9 of the camera 10. A portion 19 of the re- 
flected light passes through the beam splitter 12 toward the 
camera 10. The remaining part of the rays reflected from 
the item 8 and the belt 6 is reflected back by the beam 
splitter 12 to the light -emitting diode matrix 41. 

[3 0] Figure 6 schematically shows an assembly which oper- 
ates with transmitted and reflected light. An item sensor 
3 0 detects the passage of an item 8 and transmits a signal 
to a regulating device 15 which also serves as a control de- 
vice for the light-emitting diode matrix 1 situated under- 
neath the conveyor belt 6 and the light -emitting diode ma- 
trix 31 positioned obliquely above the conveyor belt 6. At 
the same time, the regulating device 15 receives image sig- 
nals generated by the camera 10 based on image signals re- 
ceived from the sensor cone 9. The camera 10 transmits the 
signals to a control device 25 operating a gripper 35. Such 
a gripper may be a multi-arm assembly as described, for ex- 
ample, in European Patent No. 0 250 470. The camera 10 
first receives transmitted light signals and, for example, 
16-40 ms later it receives reflected light signals. It is 
to be understood that the sequence of the received transmit- 
ted and reflected light signals may have a reverse sequence. 

[31] In the Figure 7 arrangement only a transmitted light 
is used and the signals received by the camera 10 are ap- 



plied to the control device 25 which controls a storage de- 
vice for distributing the incoming items 8. The camera 10 
may be an apparatus which detects the position and dimension 
of the items 8 and which serves as a supply system for stor- 
ing items or for controlling an item wrapping machine or the 
like. 

[32] A synchronous control of the camera 10 and the 
light-emitting diode matrix 1 is effected by a system con- 
trol 15 shown in Figure 6 but not shown in Figure 7 . 

[33] Figure 8 shows a further embodiment with which the 
gripper 3 5 is controlled with precision by means of a simple 
transmitted light process. This embodiment is a simplifica- 
tion of the Figure 6 arrangement, inasmuch as no reflected 
light is used. 

[34] Figure 9 shows an arrangement where the camera 10 is 
positioned in the working zone of the gripper 35. By means 
of a suitable logic system of the control device 25 either 
the shadows emanating from the gripper 3 5 may be eliminated 
by computation with the aid of several images or suitable 
exposures are taken only if no mechanical component (arm or 
gripper part) of the gripper 35 protrudes into that portion 
of the sensor cone 9 which is to be evaluated. In this man- 
ner the respective location of the items 8 in the working 
zone may be directly and timely predicted. As a result, a 
gripper 3 5 operating with high precision and having a very 
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small spatial requirement may be obtained. In such a case, 
between the housing of the light -emitting diode matrix 1 and 
the conveyor belt 6 preferably a transparent plate, for ex- 
ample, a glass plate is inserted which protects the light - 
emitting diode matrix 1 from the gripper and its grasping 
device . 

[35] In the embodiment according to Figure 10 the camera 
10 i9s flanked or at least partially surrounded by the 
light -emitting diode matrix 1 such that the camera 10 is 
centrally disposed with respect to the light -emit ting diode 
matrix. 

[36] It is noted that by a combination of reflected light 
and transmitted light with a synchronized flash illumination 
in short intervals of typically 16-4 0 ms the contour of the 
item 8 may be determined from transmitted light and addi- 
tional properties may be obtained from the reflected light 
image. It is to be understood that for both of these as- 
pects a separate, individual camera may be used. Also, the 
above -described individual devices may be combined with the 
described individual features . 

[3 7] It will be understood that the above description of 
the present invention is susceptible to various modifica- 
tions, changes and adaptations, and the same are intended to 
be comprehended within the meaning and range of equivalents 
of the appended claims. 
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